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REPORT  SUMMARY 


This  document  reports  progress  on  ARPA  contract  DAHC04-72-C- 
0001  entitled  "ILLIAC  IV  Applications  Research  at  the  Center  for 
Advanced  Computation,  University  of  Illinois  a l  Urb ana- Champaign. " 

The  principal  objective  of  this  program  is  the  development  and  testing 
of  numerical  techniques  and  software  systems  for  use  of  ILLIAC  IV  over 
the  ARPA  Network.  This  is  being  accomplished  through  activities  in 
the  following  areas: 

1.  Development  of  numerical  techniques  suitable  for  parallel 
processing  in  the  areas  of: 

a)  Computational  methods  and  linear  algebra 

b)  Linear  programming 

c)  Combinatorial  algorithms 

d)  Approximation  of  functions 

e)  Integral  equations 

f)  ARPA  Network 

2.  Development  of  an  ILLIAC  IV  multispectral  image  processin 
system 

3*  Development  of  ILLIAC  IV  language  for  the  phase  II  system 

4.  Development  of  programs  in  large  scale  calculations  such 
as  input-output  economic  modeling,  quadratic  assignment 
algorithms  for  various  classes  of  spatial  allocation 
problems,  and  atmospheric  dynamics 

5.  Development  of  Network  Access  Computer  System  —  ANTS 


1.  APPLIED  MATHEMATICS  C-ROUF 


1 . 1  Computational  Method::  in  Linear  Algebr a : 

1.1.1  bolutlon  of  Systems  of  Linear  Equations 

Numerical  methods  for  updating  the  solution  x  in  A-x-f,  due 
to  changes  in  rows,,  columns,  or  the  di sr< generation  of  a  given  row  and 
column  into  rn  rows  and  columns,  have  been  developed  [17 1  where  the  num¬ 
ber  of  operations  required  are  of  order  n'  instead  of  n '  if  the  new 
system  were  to  be  solved  "from  scratch. !<  These  techniques  increase 
the  computational  efficiency  of  handling  large  input -output  economical 
models,  cnee  the  Leontief  inverse  is  obtained  for  the  original  input- 
outpu4-  model,  the  above  methods  permit  accurate  determination  of  the 
effects  on  the  solution  due  to  changes  in  the  transaction  data. 

1.1.2  The  Algebraic  Eigenvalue  Problem 

In  collaboration  with  members  of  the  Chemistry  iopartment. 
a  direct  method  for  synthesis  of  magnetic  resonance  spectra  has  been 
developed  [6,  7].  Previously  such  spectra  were  computed  by  unwieldly 
and  inefficient  iterative  methods.  The  nev;  method  simply  converts  the 
problem  into  one  of  solving  a  generalized  eigenvalue  problem,  .'since 
the  matrices  involved  are  then  of  special  form,  some  thought  is  being; 
given  to  improved  methods  of  solving  the  generalises  el;  e rvalue  mob 3 em 
which  is  obtained. 

An  efficient  parallel  algorithm  for  finding  the  leading 
eigenvalues  and  eigenvectors  of  large  sparse  matrices  is  be  Par  love loped. 


This  algorithm  is  a  combination  of  Lanczos  algorithm  without  reortho- 
gonalization  [la]  and  the  simultaneous  iteration  method  [10]. 

1.2  Linear  Programming 

The  initial  version  of  the  Linear  Programming  algorithm  for  ILLIAC 
IV  has  been  completed  and  tested  on  the  simulator-  It  is  written  in 
Glypnir  to  enable  rapid  coding  and  will  bt.  tried  on  ILLIAC  T.V  as  soon 
cs  the  hardware  is  sufficiently  reliable.  A  document  [13]  describing 
the  algorithm,  a  numerically  stable  version  of  the  simplex  method  based 
on  work  by  Gill  and  Murray  [9]  and  Saunders  [18],  has  been  produced. 
Further  enhancements  to  improve  the  speed  of  the  algorithm  are  in  hand, 
also  theoretical  work  to  adapt  the  algorithm  to  handle  larger  problems 
requiring  auxiliary  storage  has  been  done. 

A  macrix  generator  language  has  been  developed  to  allow 
rapid  specification  of  large  matrices,  mainly  for  use  in  large  linear 
programming  problems.  This  provides  the  user  with  the  capability  to 
create  a  matrix  made  up  of  many  sabmat rices  of  specific  types  corre¬ 
sponding  to  some  economic  or  physical  model.  Implementation  of  this 
algorithm  is  proceeding,  and  it  is  hoped  that  eventually  it  will  be 
t  sed  to  generate  a  code  for  ILLIAC  IV  in  such  a  way  as  to  allow  storage 
of  j.arge  matrices  very  economically.  To  this  end  some  code  has  been 
written  for  ILLIAC  IV  to  handle  special  types  of  substructures  (e.g. 
oi agonal  matrices,  lower  triangular  matrices.)  However,  much  work  re¬ 
mains  to  be  done. 

1 . 3  Combinatorial  Algorithms 


The  Dulmage-nendolsohn  algorithm  [8]  for  finding  maximum 


matchings  in  bipartite  graph:'  was  progr pruned  in  PL/l  and  tested  as  part 
of  the  work  on  optimal  lo.er  triangularization  of  sparse  matrices. 

A  theoretical  report  or  rde  quadratic  assignment  pro.  lem  was 
finished  and  published  as  a  CAC  document  [l6]. 

A  technical  memoiandum  [15 3  was  published  on  the  new,  parallel 
algorithm  for  clique  detection.  The  PL/l  program  is  now  clearly 
commented. 

A  completely  new  olgortihm  lor  clique  detection  has  been 
developed,  written  and  tested  in  PL/ I;  tven  the  cliques  of  a  graph  G, 
which  is  a  subgraph  of  Graph  G’  with  the  same  nodes,  but  fewer  edges, 
this  new  algorithm  finds  the  cliques  of  G‘  from  those  of  G.  In  graphs 
arising  from  a  threshold  applied  to  a  symmetric  matrix,  an  algorithm 
of  this  type  enables  the  threshold  to  vary  dynamically. 

1 . h  Approximation  of  Functions 

A  study  of  simultaneous  uniform  approximation  of  sets  of  curve 
by  straight  lines  with  different  intercepts  but  common  slope  was  com¬ 
pleted  [2,  3l*  The  more  difficult  (but  related)  problem  of  imple¬ 
menting  and  testing  an  algorithm  for  simultaneous  approximation  by 
' xponentials  with  common  exponential  factor  was  then  tackled.  Two 
distinct  computer  programs  were  ultimately  written.  In  one  improved 
approximations  were  constructed  using  the  solutions  of  certain  linear 
inequalities.  The  other  program  uses  Hemes -type  techniques  (successive 
approximations  of  error  maxima) .  This  second  method  was  by  far  the 
fastest,  but  *  .perience  with  the  first  method  has  been  valuable  in  that 


it  should  be  more  easily  extended  to  situations  involving  more  compli- 


cated  approximating  functions,  such  as  suras  of  exponentials.  More 
information  on  this  work  will  be  available  in  [U],  a  condensed  version 
of  which  has  been  prepared  for  publication  [53- 

In  another  line  of  work,  application  of  a  previously  developed 
theory  [12]  to  approximation  by  families  with  a  fixed  point  has  been 
worked  out  [11].  Such  approximation  should  be  very  •  -eful  in  certain 
practical  situations,  for  example  in  fitting  an  experimental  curve  by  a 
theoretical  one  which  according  to  theory  must  pass  through  a  given 
point  (the  origin,  for  instance). 

1 . 3  Integra.1  Equations 

A  brief  survey  of  methods  available  for  the  numerical  solution 
of  integral  equations  showed  that  an  area  particularly  in  need  of  study 
is  that  of  methods  for  solving  integrodifferential  equations  of  the  type 
arising  in  population  dynamics  or  in  other  physical  situations  governed 
by  dynamic  equations  which  include  the  past  history  of  the  system  (e.g. 
fatigue  effects).  Some  computer  experiments  were  done  and  a  theoretical 
stability  analysis  was  carrier  out  for  a  simple  first  order  method  [1], 
1.6  AftPA  Network 

A  security  code  was  developed  for  the  APPA  Network .  Tne 
code  enables  a  user  to  log  onto  the  system  by  using  his  code  number  Xq 
which  is  immediately  transformed  into  a  pseudo  code  word  Yq  ~  f(X<)  by 
the  host  computer.  Even  though  Yj.  and  f  are  public  knowledge  it  is  not 
possible  to  gain  access  to  the  system  without  knowing  X,  and  the 
equation  Y  -  f(x)  cannot  be  solved  for  X, 


even  if  Y  is  known . 
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2.  ILLIAC  IV  MULTI SPECTRAL  IMAGE  PROCESSING 


2 . 1  Image  Processing  for  Pattern  Recognition 

III  March  the  Center  successfully  completed  grant  negotiations 
with  NASA/ AMES  in  support  of  system  developments  for  ILLIAC  IV  inter¬ 
pretation  of  ERTS-1  imagery.  CAC  has  completed  ILLIAC  codes  for 
nonsupervised  clustering  of  re  iution  elements  into  those  terrain 
categories  most  separable  with  respect  to  spectral  properties,  and 
multivariate  Gaussian  statistical  classification  of  image  points  into 
aggregate  terrain  categories.  This  work  has  been  conducted  with  partis 
ipation  by  the  Laboratory  for  the  Applications  of  Remote  Sensing 
(LARS)  of  Purdue  University.  Progress  in  now  underway  to  verify  the 
correctness  of  these  parallel  codes  by  comparison  with  output  from  the 
LARS  serial  computing  system.  Reports  on  this  work  should  be  complete*, 
for  NASA  and  ARPA  by  midsummer. 

It  is  expected  that  the  scope  of  this  project  will  be  ex¬ 
tended  in  the  next  few  months  with  additional  support  from  the  EROS 
program  of  UEGS/hl  to  include  the  design  of  a  more  comprehensive  ILLIAC 
ERTS  image  processing  system  to  support  *IASA/U3GG  earth  resource  moni¬ 
toring  objectives. 

In  addition  to  present  contractual  commitments,  CAC  is 
investigating  a  new  methodology  for  general  image  processing  and  patter 
recognition  work  which  is  expected  to  contribute  to  the  solution  of 


image  registration  problems  occurring  within  the 
boundary  changes  over  time.  The  method  employe  1 
to  a  wider  class  of  pattern  recognition  problems 
patterns  are  to  be  classified.  A  report  on  this 


analysis  of  resource 
also  seems  applicable 
where  proto type -do. . vod 
work  to  NASA  and  ARTA 


is  forthcoming. 
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3.  ILLIAC  IV  LANGUAGE  DEVELOPMENT  FOR  THE  PHAGE  II  SYSTEM 


3-1  IDOL 

Although  the  IDOL  report  was  not  an  overwhelming  success  (from 
the  point  of  view  that  it  elicited  no  support  for  implementation),  the 
work  performed  to  define  IDOL  revealed  that  there  is  something  to  be 
gained  by  applying  the  storage  management  techniques  which  form  the 
foundation  for  the  IDOL  approach  in  contexts  other  than  that  of  ILLIAC  IV. 
A  language  and  compiler  which  could  provide  accurate  working  set  infor¬ 
mation  to  an  operating  system  prepared  to  use  it  could  (cn  the  basis  of 
Belad  *  s  work)  permit  .1  100  per  cent  increase  in  throughput  in  the  same 
physical  memory.  Generalisation  of  the  techniques  suggested  could  be  used 
to  intelligently  control  the  flow  of  information  between  levels  of  a 
memory  hierarchy  (  of  more  than  two  levels). 
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4.  ECONOMIC  RESEARCH  GROUP 

4.1  STEP  l 

During  this  period,  work  under  ARPA  support  of  STEP  I  was 
completed.  The  STEP  I  system  has  been  used  for  several  forecasts  of 
occupational  employment  for  the  United  States  and  is  to  be  maintained 
and  applied  as  need  arises. 

The  principal  research  activity  of  the  group  under  ARPA  support 
has  emphasized  the  development  of  efficient  computational  algorithms  for 
large  linear  computations  in  which  matrices  are  subject  to  modifications 
of  one  or  a  few  rows  or  columns. 

4.2  .  TEP  11 

Members  of  the  group  responsible  for  STEP  II  have  left  employment 
at  the  Center  for  other  positions.  As  a  result,  planning  and  design  of 
STEP  II  under  ARPA  support  has  been  temporarily  suspended. 

It. 3  MEASURE 

'Work  on  the  MEASURE  activity  has  been  transferred  to  the 


Information  System  Group. 
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<5.  NETWORK  SYSTEMS  GROUP 

5 . 1  Project  to  Interface  the  B670Q  to  the  ARPA  Network 

During  the  period,  the  University  of  California  at  San  Diego 
(UCSD)  67OO  entry  to  the  network  was  improved  and  expanded.  The  Center 
will  no  longer  have  any  responsibility  in  the  area  of  interfacing  Burroughs 
Bo700‘s  to  the  network. 

5 . 2  ARPA  Network  Terminal  System  Development 

During  the  reporting  period,  development  of  ANTS  progressed  in 
completing  the  Mark  I  system,  and  initial  design  and  coding  efforts  on  the 
Mark  II  system  progressed. 

The  Mark  I  system  is  now  stabilized  and  a  crash  rate  of  1  to  3 
per  day  has  been  attained.  No  further  activities  will  be  involved  in  up¬ 
grading  or  maintaining  Mark  1  as  all  Center  personnel  will  be  involved  in 
the  development  of  the  Mark  II  system. 

The  remaining  effort.:  of  the  group  during  the  period  were  to 
complete  software  necessary  to  operate  with  the  UCSD  computer  center  via 
the  network  ,  to  upgrade  the  PEESPOL  compiler  for  additional  support  in 
developing  Mark  II  ANTS  for  the  next  reportin  ;  period  and  to  lay  down  the 
design  specifications  for  the  Mark  II  system. 

The  Mark  II  system  design  is  complete  to  the  point  of  allowing 
initial  coding  and  debugging  activities  to  begin.  It  is  expected  that 
during  the  second  quarter  of  l/H,  the  Mark  II  system  will  be  brought  to 
an  operational  status,  first  to  a  lev  1  equivalent  to  the  M  I  system 


13- 


and  then  later  to  include  increasing  numbers  of  peripheral  devices,  proto¬ 
cols  and  associated  activities. 

5 . 3  ARPA  Network  Usage 

During  the  reporting  period,  network  usage  continued  very  hea¬ 
vily  on  the  UCS.D  B6700  system,  UCLA  360/91  (both  for  RFE  and  ISO  usage), 
various  Tenex  systems  around  the  network  (predominantly  USC-IS-),  the 
Multics  system,  and  the  Ames  TSS  360/67  system.  In’tial  efforts  were 
begun  during  the  reporting  period  to  begin  access  and  experimental  usage 
of  the  ILLIAC  XV  complex  at  Ames. 

5 . 4  Further  Installation  of  ANTS  Systems  on  the  network 

During  the  reporting  period,  more  contact r  were  made  with  addi¬ 
tional  sites  for  information  as  to  the  availability  of  an  ANTE  system  to 
provide  those  sites  with  access  to  the  network.  The  University  of 
California  at  Los  Angeles  has  elected  to  replace  their  Ligma  7  computer 
system  with  an  ANTS  for  access  to  the  network  in  the  network  measurement 
project  supported  by  ARPA.  Additionally,  further  work  is  in  progress 
with  the  Army  to  establish  possible  follow-up  on  activities  in  the  install¬ 
ation  of  additional  sites. 

5.5  Graphics  Support  for  Center  Projects 

With  the  advent  of  the  UCGD  6'fOO  system  as  a  service  site  on 
the  network,  graphics  activities  were  continued  ana  the  development  of  a 
full  blown  user-oriented  graphics  package  initiated.  Fancy  AH PA  Network 
Graphics  System  ( FANGP  will  provide  a  very  sophisticated  and  highly  in¬ 
teractive  system  4,or  doing  graphical  analysis  and  display  of  user  desired 
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imagery.  Additionally,  programs  were  developed  for  bringing  back 
graphical  images  to  various  OAC  equipment  such  as  the  Gould  »  letter, 
Computek  graphics  copies,  the  IMLAC  hi splay,  and  a  soon  to  be  acquired 
drum  plotter  system. 

Additional  work  is  being  initiated  in  the  production  of  half 
tone  imagery  on  the  IKLAC  Display  as  a  supporting  function  to  the  B’RTo 
imagery  project  which  will  be  developing  algorithms  and  analysis  system 
on  ILL I AC  IV  for  SRTG  imagery. 

5 • 6  Hardware  Acquisition 

During  the  reporting  period,  negotiations  were  completed  with 
the  Digital  Equipment  Corporation  for  additional  hardware  at  the  Center 
based  on  the  advanced  concepts  PDP-11  model  45  processor  and  memory  sys¬ 
tem  to  provide  Center  research  personnel  with  an  advanced  capability 
access  system  for  the  AK'PA  Network.  The  software  system,  known  as  The 
Network  Imbedded  Compute!  Executive  (NICE'  will  be  developed  for  the 
11-45*  Design  activities  will  begin  during  the  next  reportin'  period. 

5 . 7  Laboratory  for  Atmos? heric  Research  Purport 

Support  for  the  University  of  .'llinois  at  Urbana-Champaign 's 
Laboratory  for  Atmospheric  I-exeareh  fLAE',.  under  the  direction  of 
Professor  Lgura.  consisted  of  the  procurement  of  a  drum  plotting  device, 
to  be  attached  to  the  Center’s  ALTC  system,  and  the  writing  of  graphics 
packages  at  several  network  sites  for  dis.iv/  of  the  laboratory's 
research  results. 

The  drum  plotter  was  ordered  during  the  reporting  period  and 
will  be  deli ve re d  i n  May , 
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Basic  graphics  display  software  was  written  on  the  UCLA 
360/91  and  the  University  of  Southern  California’s  Information 
Services  Institute’s  PDF- 10  for  display  of  the  laboratory’s  meteor  • 
ology  research  results.  Graphics  images  can  be  returned  from  either 
place  to  the  IMLAu  display,  the  Computek  storage  scope  or  the  GOULD 
printer/plotter  attached  to  ANTS 

During  the  next  reporting  period,  inhouse  graphics  display 
software  will  be  written  at  UCLA  and  USC-ISI  to  provide  more  soph¬ 
isticated  output  of  LAR  results.  The  plotter  will  be  interfaced  to 
ANTS  and  added  to  the  repertoire  of  graphics  devices  available  to 


LAR  researchers. 
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6.  ADMINISTRATION 


6.1  Fiscal  Status 

Actual  expenditures  through  30  September  1972:  $1,527,323. 

Estimated  expenditures  and  obligations  for  the  six  month  period 
covered  in  this  report  (  1  October  1970  -  31  March  1973): 


October 

106,734 

November 

132,550 

December 

108,  T  2 

January 

i?M33 

February 

86,1*52 

March 

lUl,058 

700, 699 

Total  expenditures  and  obligations  through  jl  March  1973:  $2,226,022. 
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